Skip to content

Support for alternate data formats#299

Merged
robertbartel merged 4 commits intoNOAA-OWP:masterfrom
robertbartel:f/alternate_data_formats/isolated
Jun 12, 2023
Merged

Support for alternate data formats#299
robertbartel merged 4 commits intoNOAA-OWP:masterfrom
robertbartel:f/alternate_data_formats/isolated

Conversation

@robertbartel
Copy link
Copy Markdown
Contributor

Adding support for data formats to have satisfactory alternate formats. This enables, e.g., a requirement for a forcing dataset to be fulfilled by a dataset with a format that doesn't strictly match that specified by the requirement.

Note that this supersedes #276. It is effectively the same change set (small modifications were done due to package versions needing to be further bumped) rebased onto the current master commit.

@robertbartel robertbartel added the maas MaaS Workstream label Mar 14, 2023
@robertbartel robertbartel added the enhancement New feature or request label Mar 15, 2023
aaraney
aaraney previously approved these changes Mar 20, 2023
Copy link
Copy Markdown
Member

@aaraney aaraney left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! All I would ask is to open an issue to track adding tests to this area of the code in the future!

@robertbartel robertbartel force-pushed the f/alternate_data_formats/isolated branch 2 times, most recently from 1b10e8b to 4c3b081 Compare March 24, 2023 14:03
Adding DataFormat.can_format_fulfill class method to test if alternative
data format is compatible, and updating logic of DataDomain.contains
method to test and account for this type of compatibility.
Updating dmod.dataservice to depend on updated dmod.core (>=0.8.0).
Updating service manager find_dataset_for_requirement method to account
for potentially compatible alternative dataset formats and examine any
datasets having such formats if there are no matches with exactly the
specified format.
@robertbartel robertbartel force-pushed the f/alternate_data_formats/isolated branch from 4c3b081 to 07e3dc0 Compare June 9, 2023 16:25
@robertbartel
Copy link
Copy Markdown
Contributor Author

@aaraney, I've rebased and force-push the updated branch, so this will need another review.

@robertbartel robertbartel merged commit 65c4ed5 into NOAA-OWP:master Jun 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request maas MaaS Workstream

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants